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Abstract. We find explicitly the multiplicities in the (mixed) trace cochar- 
acter sequence of two 3x3 matrices over a field of characteristic and show 
that asymptotically they behave as polynomials of seventh degree. As a con- 
sequence we obtain also the multiplicities of certain irreducible characters in 
the cocharacter sequence of the polynomial identities of 3 X 3 matrices. 



Introduction 

All considerations in this paper are over an arbitrary field F of characteristic 0. 
Let n > 2 be a fixed integer. Consider the d generic n x n matrices X%, . . . ,Xd, 
d > 2. The main results of our paper concern the case n = 3 and d — 2. There are 
several important algebras related to X%, . . . , X&. Among them are the algebra Rd 
generated by X\, . . . , Xd, the pure (or commutative) trace algebra Cd generated by 
the traces of all products tr(Xj 1 • • • Xi k ), and the mixed (or noncommutative) trace 
algebra Td generated by Rd and Cd regarding the elements of Cd as scalar matrices. 
We denote by C, R, and T the corresponding algebras related to a countable set 
{Xi, X-2, ■ ■ ■} of generic matrices. 

The algebra R is one of the most important objects in the theory of algebras with 
polynomial identities. It is isomorphic to the factor algebra F{x\, X2, ■ ■ .)/I(M n (F)) 
of the free associative algebra F{x\,x%, . . .) modulo the ideal I(M n (Fj) of the 
polynomial identities of the n x n matrix algebra M n (F). The algebra Cd has a 
natural interpretation in classical invariant theory, as the algebra of invariants of 
the general linear group GL n (F) acting by simultaneous conjugation on d matrices 
of size n. The algebra Td is known as the algebra of matrix concominants and also 
consists of the invariant functions under a suitable action of GL n (F). See e.g. the 
books or |B] as a background on Rd,Cd, and Td and their application to 

invariant theory, structure theory of Pi-algebras, and theory of finite dimensional 
division algebras. 

The algebras Rd, Cd, Td as well as R, C, T are graded by multidegree. The sym- 
metric group Sk acts naturally on the multilinear elements of degree k of R, T, C. 
The corresponding ^.-characters Xk(R) = Xk(M n (F)),Xk(C),Xk(T) are called, re- 
spectively, the cocharacter of the polynomial identities, the pure trace cocharacter, 
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and the mixed trace cocharacter of n x n matrices. They decompose as 
Xk(M n (F)) =Y j mx{M n {F)) X x, 

Ahfc 

X,(C)=^m A (C) X A, 

Ahfc 

Xk{T) = ^m A (T)xA, 

Ahfc 

where A is a partition of k and x\ is the related irreducible S^-character. If some 
of the multiplicities ni\{M n (F)), m A (C), m A (T) is nonzero, then A = (Ai, . . . , A„2) 
is a partition in not more than n 2 parts. 

The algebras Rd,C d ,Td are also GL^F^-modules with GLd(F)-action induced 
by the canonical GL^-F^-action on the vector space with basis {X\, . . . ,Xd} and 
decompose as 

i?d = 5I^m A (M n (F))WA, C d = J2J2 m ^ W ^ T d = J2J2 m ^ W ^ 

fc>0Ahfc fc>0Ahfc fc>0Ahfc 

where W\ is the irreducible GLd(F)-module related to A = (Ai, . . . , Ad), and the 
multiplicities of W\ are the same as the multiplicities of x\ m the corresponding 
S'fe-cocharacter. 

The Hilbert (or Poincare) series of Rd is 

H(R d ) = H(R d , h, . . . , t d ) = ^ " • ' 

where R d ^ is the homogeneous component of multidegree k — [k\, . . . , kd). Sim- 
ilarly one defines the Hilbert series of Cd and Td- These series are symmet- 
ric functions and decompose as infinite linear combinations of Schur functions 
S\(t±, . . . ,td). Since the Hilbert series play the role of characters of GLd(F) and 
the Schur functions are the characters of the corresponding irreducible GLd(F)- 
modules, the multiplicities m\(M n (Fj), m\{C), and m\(T) can be obtained from 
the Hilbert series of Rd,Cd, and Td for d = n 2 . For small d, the Hilbert series 
give the multiplicities for A = (Ai, . . . , A^) only. See the book by Macdonald fH5] 
as a standard reading on theory of symmetric functions and the book by one of 
the authors 5 for the applications of representation theory of Sk and GLd{F) to 
Pi-algebras. 

The algebras C and T are described in terms of invariant theory and are easier 
to study than the algebra R. Since the three algebras are very close to each other, 
the standard way to investigate the polynomial identities of M n (F) is via C and T. 
The multiplicities of the cocharacters of M n (F) , C, T are explicitly found for n = 2 
only, by Formanek |5| for M2(F), C, T, and, with different methods, by Drensky |3] 
for M2(F), see also Procesi ^3]. In particular, 

m A (T) = (Ai - A 2 + 1)(A 2 - A 3 + 1)(A 3 - A 4 + 1), 

if A = (A 1; A 2 , A 3 , A 4 ) and m A (T) = if A 5 + 0. 

It follows from classical invariant theory that the Hilbert series of Cd and Td 
can be expressed as multiple integrals but for n > 3 their direct evaluation is quite 
difficult and was given by Teranishi ^3 ^] for G 2 and n = 3 and n = 4 only. Van 
den Bergh ^B] found a graph theoretical approach for the calculation of H(Cd) 
and H(Td). Bcrele and Stembridge 2^ calculated the Hilbert series of Cd and Td 
for n = 3, d < 3 and of T 2 for n — 4, correcting also some typographical errors in 
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the expression of iJ(C 2 ) for n = 4 in HE]. Using the Hilbert series of C 2 , ?i = 3, 
Berele pQ found an asymptotic expression of m(\ 1 ,\ 3 )(C)- The explicit form of the 
generating function of m^ ^) (C) was found by Drensky and Genov [x] correcting 
also a technical error in pQ. The proof of is quite technical. Later Drensky 
and Genov [Hj suggested a method to find the coefficients of the Schur functions 
in the expansion of a class of rational symmetric functions in two variables. This 
significantly simplified their proof of the formula for the generating function of 
to (Ai,a 2 )(C)- A recent general result of Carbonara, Carini and Remmel [2 states 
that, for any n, there exists a positive integer u n , such that for a fixed partition 
A = (A2, . . • , A„2), there exist u n polynomials P£ ^(Ai), k = 0, 1, . . . , u n — 1, of degree 
n — 1 and with the same leading term, with the property that m\(C) = t(Ai), 
for Ai sufficiently large, where A = (Ai, A) = (Ai, . . . , A„2), k = Ai mod u n . Since 
the cocharacter sequences of C and T are related by XkiT) = Xk+i{C) I Sk, and 
the multiplicities m\(T) can be expressed in terms of the multiplicities of C by the 
branching theorem, this easily implies a similar statement for m\(T). For n = 3 
the expression of u n given in [3J is M3 = 6. 

The purpose of the present paper is to calculate, for n = 3, the generating 
function of ™(Ai,a 2 )(T) an( i to find explicit expressions for m^x 1 .x 2 )(T). As in the 
case of m^Xi,\ 2 ) (^)> see DP' the multiplicity m(^ lt ^ 2 )(T) behaves asymptotically as 
a polynomial of degree 7 in Ai and A2. Our approach is to apply the method of 
Drensky and Genov 8 to the explicit form of the Hilbert series of T2 found by 
Berele and Stembridge As a consequence of some results of Formanek |31 ll(J| 
we obtain the exact values of the multiplicities m\(M 3 (F)) for A = (Ai, . . . , Ag) 
when A3 = • ■ • = Ag > 2. The calculations have been performed independently by 
the first and the third authors in Palermo and by the second author in Sofia, as an 
additional warranty of their correctness. In both cases we have used Maple. 

1. Preliminaries 

Let F[[x, y]] be the algebra of formal power series in two variables and let 

Sjm[[x,y]] = F[[x,y]} S2 

be the subalgebra of symmetric functions. The set of Schur functions 

{S x (x,y) I A = (Ai,A 2 ) 6 Z x Z, Ai > A 2 > 0} 

forms a basis of Sym[[i£, y]] as a topological vector space with its usual formal power 
series topology. Hence for any symmetric function f(x,y) in two variables, 

f( x ,y) = ^2 a(i,j)x l y : > = ^2m(\)S\(x,y), 

i,j>0 A 

where a[i, j) = a(J, i) s F for alii, j > and m(A) £ F is the multiplicity of S\(x, y) 
in the decomposition of f(x,y). The Schur function S\(x,y) has the following 
simple expression 

(xv) X2 (x p+1 — v p+1 ) 

S x {x, y) = (xy)^(xP + x^y + ■■■+ xy^ 1 + y?) = y - >-, (1) 

x-y 

where we have denoted p — Ai — A 2 . This easily gives that the coefficients a(i,j) 
and the multiplicities 771(A) of f(x,y) are related by 

m(Ai, A 2 ) = a(Ai, A 2 ) - a(A x + 1, A 2 - 1), 
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where a(Ai + 1, A 2 - 1) = if A 2 = 0. 

Drcnsky and Genov introduced the multiplicity series of f{x,y), namely 

M(f)(t,u)= J2 rn{X u X 2 )t x 'u X2 eF[[t,u]]. 

Ai>A 2 >0 

Introducing a new variable v = tu, the series M(f)(t, u) accepts the more convenient 
form 

M'(f)(t,v) = M(f)(t,u) = Yl ™(Ai,A 2 )t Al - A V 2 e F[[t,v}] 

Ai>A 2 >0 

and the mapping M' : Sym[[x , y]] — ► -F[[i,i>]] is a continuous linear bijection. 

The relation between symmetric functions and their multiplicity scries is given, 
see (11) in 0, by 

ff x xM'(f)(x,xy)-yM'(f)(y,xy) f 

f{x,y) = • (2) 

x-y 

The symmetric functions depending on the product xy only behave like constants 
under the mapping M' . If a{z) G ^[[z]] is a formal power series in one variable z, 
then 

M'(a(xy)f(x, y)) = a(v)M'(f(x, y)), (3) 
for any symmetric function f(x,y), see (10) in [7]- 

We consider two linear operators Y and Y a of F[[t, v]]. If h(t, v) e F[[t, u]], there 
exists a unique /(a;, y) € Sym[[x, y]] such that /i(<, w) = M'(f). As in [7], we define 



Y{h){t,v) = M' 
Similarly, if a(z) G ^[[z]], then 

Y a (h)(t,v)=M' 



(l-x)(l-y) 
f(x,v) 



(1 - a(a^/)x)(l - a{xy)y) / 
Clearly, Y — Y\. The next lemma gives relations between h(t, v), Y(h), and Y a (h). 
Lemma 1. Ifh(t,v) £ F[[t, v]] and a(z) € F[[z]), then 

Ym,v) = th % V \-" h{V \ V) , (4) 
(1 -*)(*- v) 

th(t,v) - a(v)vh(a(v)v,v) 

Y a (h)(t,v) = — . (5 

(1 — a(v)t)(t — a(v)v) 

Proof. The first equation is established in Proposition 2 of |7] and the second in 
Lemma 1 of [8]. Since jo] is an announcement only, we give the proof for com- 
pleteness of the exposition. Since the mapping M' is linear and continuous, it is 
sufficient to verify (5) for the image h(t,v) = M'(S\(x,y)) of the Schur functions 
only. By (1) and (3) we may assume that A 2 = 0, i.e. A = (p, 0), and we obtain 
that h(t,v) = t p . Direct verification shows that the right hand side of (5) has the 
form 

tP +1 - {a{v)v)P +1 



h a (t,v) 
>w that 
xh a (x,xy) = 



(1 - a(v)t)(t - a(v)v)' 

Further calculations show that 

x p+1 - {xy) p+1 a(xy) p+1 



(1 - a(xy)x){\ - a(xy)y)' 
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xh a (x,xy) - yh a (y,xy) x p+1 - y p+1 



x-y (x - y)(l - a(xy)x)(l - a(xy)y) 

= S {pfi) (x,y) 

(1 - a(xy)x)(l - a(xy)y) ' 
i.e. S l ( Pi o)(x, y) and h a (t,v) satisfy the relation (2). Since M' is a bijection, this 
completes the proof. □ 

Finally, we need the following equality which is a translation in our language of 
a partial case of a result of Thrall (TJ|, see also (8) in 0: 



M '{(l-x2)(l-xy)(l-y 2 )) (l-t 2 )(l-v 2 Y (6) 
2. Main Results 

Till the end of the paper we consider 3x3 matrices only, i.e. we fix n = 3. Most 
of our considerations are for d = 2 and we replace the variables ti, t 2 with x, y. The 
Hilbert series of T 2 found by Berele and Stembridge [2] is 

H(T 2 , x, y) = ^ - - - _ - _ _ ^ . (7) 

The first of our main results gives the multiplicity series of this Hilbert series. 

Theorem 2. The multiplicity series of the Hilbert series H(T 2 , x,y) of the mixed 
trace algebra T 2 of two generic 3x3 matrices is 

M (H(T 2 ,x, y))(t, v) = — v)7(i - v)4(i - v2)(i m + m _ - , (8) 

where the polynomials hi(v) € F[v], i = 0, 1, 2, 3, are 

h 3 (v) = v 2 (v 4 - v 3 + 3v 2 - v + 1), h 2 (v) = v{2v 4 - 4v 3 + v 2 - v - 1), 

hi(v) = v(-v 4 - v 3 + v 2 - 4v + 2), ho(v) = v A - v 3 + 3v 2 - v + 1. 
It has also the expression 

A/r'fTj(rr \\n \ ° 3 ^) a2 ^ 1 , c ^ fa\ 

M(H(T a ,x,y))[t,v)^-^^ + ^^ + ^ + — + —, CM 

where 

1 . _ (3v 2 -2v + l) 



ai(v) 



2(l-vf(l + v) 2 ' zy ' 2 2 (l-v) 7 (l + v) 3 ' 
(v A - 6v 3 + Uv 2 - 6u + 1) 



2 3 (l-v)»(l + v) 4 
b ( v ) = S57i — ,,,,, 1 ,,4^ I :on . c ( u ) 



2 3 (l-t;) 2 (l + w) 4 (l + w 2 )' v ' (l-w) 8 (l + w) 4 (l + v 2 )' 

Proof. Direct calculations, which we have performed using Maple, show that the 
expressions from the right hand sides of (8) and (9) are equal. So, the proof will be 
completed, if we show that the replacement of any of these expressions in (2) gives 
the Hilbert series in (7). This has been done also using Maple. 

We think that it is interesting to know how we have calculated (8) and (9). We 
rewrite H(T 2 , x,y) in the form 

1 / 1 \ 2 1 / 1 



1-xy \(1 - x)(l -y)J (1 - (xy)x)(l - (xy)y) x 2 )(l - xy)(l - y 2 ) 
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It follows from (3), (4), and (5) that 

M'(H(T 2 , x, y))(t, v) = ~^Y 2 Y Z M' ^ 1 
Taking into account (6), we obtain 

M'(H(T 2 ,x,y))(t,v) = -^—Y 2 Y Z 



xy){l - y 2 ) 



l-v 2 \(l -t 2 )(l -v 2 ))' 
Now we calculate consecutively 

1 



w (t,v) = 
wi = Y z (w ) 
w 2 = Y(w 1 ) 
w 3 = Y(w 2 ) 



(l-t 2 )(l-v 2 )' 
1 + v 2 t 



(i - v 2 ) 2 (i + v 2 )(i - t 2 )(i - vty 

_ (-v 2 (v 2 - v+ l)t 2 - v{v 2 - l)t + (v 2 - v + 1)) 
" (1 - v) 4 (l + v) 3 (l + v 2 )(l - t) 2 (l + t)(l - vt) ' 

_ h 3 (v)t 3 + h 2 (v)t 2 + hjjrft + hp(v) 

~ (1 - w) 6 (l + w) 4 (l + w 2 )(l - t) 3 (l + i)(l - wt) ' 

M'(ir(T2,a:,y))(t,i;)=i«4= "'' 



as in (8). The expression (9) is obtained considering (8) as a rational function in t 
with coefficients from F(v) and presenting it as a sum of elementary fractions. □ 

Lemma 3. The function M'{H{T 2l x, y))(t, v) can be presented in the form 

J2 « + + (-i)X + (-ir +q K) t p v g - ^ E (-i) p+r *v r+1 

p,(j>0 p,r>0 

+ y, [4 + (-i) s c-](tvrv° + ± y (-intvfv 2 ™, 

p.s>0 p,w>0 

where 

+ _ (8Ap 2 + Upq + q 2 )q 5 (40p 2 + Ylpq + q 2 )q A (90p 2 + 4Qpq + 5q 2 )q 3 
a Pq - ^7! + 285! + ¥i 2 

(104p 2 + 108pg + 15g 2 )g 2 (19596p 2 + 43666pg + 9599g 2 )g 
+ 2^3 + 266! 

1800p 2 + 11676 P (7 + 4993g 2 9492p + 11437g 43 
+ 265! + 2 9 • 3 • 7 + 64' 

(12p 2 + I8pq + 7q 2 )q 8p 2 + 28pq + 17q 2 180p + 229g 13 
a pi ~ ^103 + 2? + 293 + 64' 

+ g + 4 2q 3 + 24g 2 + 85g + 84 

q ~ 2 8 ' q ~ 2 8 3 ' 

+ _ s 7 s 6 19s 5 s 4 391s 3 79s 2 1453s 17 
c s =- -357! ~ 2651 ~ 2^6!" ~ 283! + 2 6 6! + 2 T5 5 ~ 2 7 5!7 ~ 2 1 "' 

s 3 + 9s 2 + 17s-3 
Cs ~ 2103 ' 
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Proof. We decompose the rational functions 03(11), 0.2(f); a i( u )i b(v), c(v) £ -F'(v) as 
linear combinations of elementary fractions of the form 

1 lli; 



(l-v) k ' (l + i) fe ' l + i 2 ' 1 + 1> 2 ' 

The results are 

1 1 3 1 

a 3(v) = 777 777 + 7777, -TT + 777777 77 + 



+ 



8(1 -vf 8(1 -v) 5 32(1 -i-) 4 16(1 -v) 3 
5 3 13 



128(1 -v) 2 128(1 -v) 128(1 + v) 2 128(1 + v) ' 
1 1 1 11 
a 2(^) = 777 3? - 777 77; + 777 774 + 



16(1 -w) 7 32(1 -vf 32(1 -v) 4 256(1 - v) 3 
21 17 3 13 17 

+ 7777777 77 + 7777777 7 + 777/7777 77 + 7777777 77 + 



512(1 -v) 2 512(1 -v) 256(1 + vf 512(1 + 1) 2 512(1 + v)' 

, s 1 1 1 5 

32(1 -i-) 8 32(1 -i) 6 32(1 -i) 5 512(1 - v) 4 
3 25 29 

+ 7777777 77 + 77777777 77 + 



256(1 -v) 3 1024(1 -i) 2 1024(1 - v) 

7 7 33 29 

+ 



512(1 + i) 4 256(1 + v) 3 1024(1 + 1) 2 1024(1 + i>) : 

1 3 1 1 

b ( v ) = 7777 172 + 7777 3 + 777 , 774 + 



256(1 -v) 2 256(1 -u) 64(1 + 1>) 4 32(1 + i>) 3 
9 7 v 

+ 256(1 + i) 2 + 256(1 + i) ~ 64(1 + i> 2 )' 

1 1 1 11 

c ( v ) = -7777—77 + 777 777 + 



32(1 -i-) 8 32(1 -i-) 7 32(1 -i) 6 512(1 - v) 4 

11 9 1 

~ 512(1 -v) 3 ~ 1024(1 -i) 2 + 256(1 - v) 

1111 

+ 7777777 77 + 7777777 7 + 



512(1 + 1-) 4 512(1 + 1-) 3 1024(1 + i) 2 256(1 + v) 64(1 + i 2 )' 
Applying the formula 



(1 - z) k + x ^ \ k 

v ; m>0 v 

for z = ±i>, — v 2 , ±i, vt, and expressing the binomial coefficients in (10) as polyno- 
mials of degree k in m, we obtain the presentation of M'(H(T2,x,y))(t,v) in the 
statement of the lemma. □ 

The following theorem gives explicit formulas for the multiplicities m(^ li ^ 2 )(T). 

Theorem 4. The multiplicities Tnr\ lt \ 2 \(T) of the mixed trace cocharacter of 3x3 
matrices are given by the following formulas, where we have presented (Ai, A2) m 
the form (p + q, q): 

™^M){T) = o+ + (-l)'o- + (-l) p 6+ + (-l) p+ "fo- - ( ~ 1 iT £l 



64 



(<-p + (-ir%~-p+ ( 1} 6 7 £2 ) 



8 



DRENSKY, GENOV, AND VALENTI 



Here e\ = 1, if q = 2r + 1 and e± = 0, if q = 2r; £2 = 1, if q — P = 2w and £2 = 0, 
if Q ~ P = 2w + 1; and 6 = 0, if Ai > 2A2 and (5=1, if Ai < 2A2. T/ie expressions 
of a^ q ,b^ , c J are given in the above Lemma 3. 

Proof. Clearly, the multiplicity ^(Ai,a 2 ) (^) = TO (p+g,g)(-^) ^ s ecma l 1° the coefficient 
of t p i? 9 in the expansion of the formal power series M'(H(T2,x,y))(t,v). This 
explains the contribution of a^ q ,b^ and £i/64 to m^ p+q q ^(T). The coefficient 
contributes to (tv) p v s , which is equal to for s = q — p. Hence we need q > p 
which is equivalent to Ai < 2A2. In this case 6—1. Otherwise 6 = 0. The 
coefficient £2 appears by the same reasons as £1. □ 

The expression of ^(Ai,A 2 )(^') becomes much simpler if we are interested in 
their asymptotic behavior only. The following corollary follows immediately from 
Theorem 4, presenting A in the form (ja + q,q). It is in the spirit of the description 
of TO(Ai,a 2 )(C) given by Berele p. 

Corollary 5. For any partition A = (Ai, A2), the multiplicities ni\ = m\{T) of the 
mixed trace cocharacter of 3 x 3 matrices satisfy the condition 

^2 , (^1 _ ^2)A 2 (Ai - A 2 ) 2 A2 „,, , 6 . 

m *=7!25 + 6!24 + 5!2^ + ° {{Xl + M) } ' 

if Ai > 2A 2 > and 

^2 . (Ai-A2)A| (Ai - A 2 ) 2 A| (2A 2 - Ai) 7 6 

mx= 7l¥ + 612* + 5!23 7!2^ + ° ((Al + ^ ] ' 

z/2A 2 > Ai > A 2 > 0. 

// A2 is fixed, then, for Ai > 2A2, 

,2 ff A 2 A ! 5A 2 13A 2 1633A 2 15 



?n A = Af 



5!2 4 2 5 • 3 2 6 4!2 5!2 5 2 6 
+ M) A2 (^ + ^))+0(Ai). 



Comparing with the asymptotic expression of m^\ lt \ 2 ^(C) in the form of Theorem 
15 in 0, we see that 

m (XlM) {C) « -m (Al:A2) (T). 

The formulas for W( Al A2 )(C) in [7] agree with the result of |3] that, for a fixed 
A2, . . . , Ag, and for A x sufficiently large, the multiplicity m\{C) behaves, depending 
on Ai mod 6, like a polynomial of second degree in Ai, with a leading term which 
does not depend on Ai mod 6. The second part of Corollary is in the same spirit. 
The careful study of the form of M'(H(T2,x,y)) from Theorem 2 shows that it is 
sufficient to consider Ai mod 2 and not mod 6. 

Finally, we give an application to the "ordinary" cocharacters of the polynomial 
identities of 3 x 3 matrices. 

Corollary 6. If /j, = (/ii, . . . ,/ig) is such that /Z3 = ■ ■ ■ = (aq > 2, then the mul- 
tiplicity m^{M^{F)) is equal to the multiplicity m(A 1 ,A 2 )(^') found in this paper, 
where Ai = fix - ^3, A 2 = ^2 - M3- 

Proof. By a result of Formanek JjJ], m Ai (T) = m\(T), for any partitions A = 
(Ai, . . . , A„2) and /1 = (/ii, . . . , /i„2) related by the equalities pik = A& + r for all 
k = 1, . . . , n 2 and all n > 2. Also, for A„2 sufficiently large, m\(M n (F)) = m\(T). 
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Another result of Formanek, in \E)l, gives that the latter equality holds already for 
A„2 > 2. This immediately completes the proof. □ 
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